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— ^with  the  remaining  digits  appearing  as  distraciors.  In  varied 
mapping  paradigms,  targets  on  one  trial  may  be  distractors  on 
another  trial  (e.g.,  the  targets  that  the  subject  has  to  search  for 
on  a  particular  trial  have  been  selected  in  the  experiment  by 
randomly  sampling  four  of  the  ten  digits,  with  the  non-selected 
items  being  potential  distractors;  since  a  new  sample  is  taken 
every  trial,  individual  digits  change  roles  as  targets/distractors 
over  trials). 


that  processing  remains  under  aoentional  conool.  This  paper 
proposes  a  priority  learning  mechanism  to  model  the  effects  of 
practice  and  the  development  of  automaticity,  in  visual  search 
tasks.  A  connectionist  simulation  model  implements  this  learn¬ 
ing  algorithm.  Five  prominent  features  of  visual  search  practice 
effects  are  simulated.  These  are;  1)  in  consistent  mapping  tasks, 
practice  reduces  processing  time,  particularly  the  slope  of  reac¬ 
tion  times  as  a  Unction  of  the  number  of  comparisons;  2)  in 
varied  mapping  tasks,  there  is  no  change  in  the  slope  of  the 
reaction  time  function;  3)  both  the  consistent  and  varied  effects 
can  occur  concunently;  4)  reversing  the  target  and  distractor 
sets  produces  strong  interference  effects;  and  5)  the  benefits  of 
practice  are  a  function  of  the  degree  of  consistency. 

Introduction 

Human  performance  changes  dramatically  as  practice  devel¬ 
ops,  leading  to  improved  performance  and  a  decrease  in  de¬ 
mands  made  on  attentive  resources.  Many  frameworks  have 
discussed  this  transition  (see  [Shiffrin  &  Schneider  1977]). 
However,  there  is  no  generally  accepted  model  of  how  per¬ 
formance  changes  with  practice.  Moreover,  although  theo¬ 
retical  frameworks  have  been  proposed,  they  have  generally 
not  provided  a  detailed  computational  account  of  hypothesized 
processing. 


A  reliable  finding  from  varied  mapping  studies  is 
that  reaction  time  increases  roughly  linearly  with  mem- 
o^  set  size  ([Kristofferson  1972a]).  Consistent  map¬ 
ping  studies  have  found  that,  with  practice,  search 
becomes  much  faster  and  memory  set  size  has  less 
impact  on  reaction  limes  than  in  the  varied  map¬ 
ping  condition  ([Neisser  1963,Neisser,Novick  &  Lazar  1963, 
Kristofferson  1972b,  Schneider  &  Shiffrin  1977]). 

These  findings  have  led  to  the  hypothesis  that,  in  varied  map¬ 
ping,  each  item  in  the  display  is  serially  compared  with  items 
in  the  memory  set,  with  each  comparison  taking  on  the  order 
of  50  msec.  In  contrast,  practice  in  the  consistent  mapping 
condition  leads  to  a  switch  from  serial,  attentional,  to  parallel, 
automatic  processing  ([Shiffrin  1988]). 

Our  focus  in  this  paper  is  on  priority  learning,  which  we 
propose  as  a  mechanism  that  models  the  effects  of  practice,  and 
the  development  of  automaticity,  in  visual  search  tasks.  We 
review  specific  experimental  results  that  have  been  obtained  in 
studies  involving  visual  search  tasks,  and  present  simulations 
indicating  how  priority  learning  can  provide  an  account  of  the 
observed  practice  and  automaticity  effects. 

An  architecture  for  attentional  effects  in  visual 


In  this  paper,  we  present  a  computational  model  of  practice 
effects  in  visual  search  tasks  (see  discussion  below),  which 
have  played  an  important  role  in  research  on  attentional  pro¬ 
cesses.  The  term  attention  is  generally  used  to  indicate  aspects 
of  human  cognitive  processing  that  the  subject  can  control, 
and  that  involve  capacity  or  resource  limitations.  Attentional 
processing  is  taken  to  be  a  slow,  serial  activity,  with  the  focus 
of  attention  limited  to  being  one  thing  at  a  time.  However, 
with  practice  in  consistent  tasks,  automatic  processes  develop 
allowing  parallel  processing  that  is  faster  and  not  as  limited  by 
attentional  resources' . 

The  distinction  between  controlled  and  automatic  processes 
has  been  the  focus  of  much  research  in  the  field,  particularly 
in  visual  search  tasks.  In  such  tasks,  stimuli  are  presented 
visually  to  the  subject,  who  is  required  to  detect  the  presence 
of  members  of  a  set  of  target  stimuli  (the  memory  set).  Non- 
target  stimuli  are  termed  distractors.  In  consistent  mapping 
paradigms,  a  target  stimulus  will  never  appear  as  a  distractor 
on  any  inal  -  for  example,  the  subject  has  to  search  the  display 
for  the  memory  set  digits  (e.g.,  the  digits  (8  4  5  2})  on  all  trials, 

•This  work  was  supporteU  in  pan  by  ONR  cooiracts  N00014-87K-0397 
and  N00014.g6-K4)678and  ARl  coni/aci  .MDA903-89-K4)174unhe  second 
author. 

*$€€  (Shiffnn  I988J  for  an  eaceUeni  review  of  rescaren  on  ioention. 


search  tasks 

This  section  describes  briefly  the  larger  architecture  for  at- 
tenlional  processing  within  which  the  priority  learning  model 
is  embedded.  The  modular  architecture  (Figure  1)  combines 
standard  connectionist  components  such  as  connectionist  units 
in  a  multi-layer  organization  (see  [Rumelhan  et  al.  1986],  for 
example)  with  control  elements  that  modulate  the  flow  of 
infoimauon  between  modules.  The  control  involves  a  gat¬ 
ing  unit  (Unit  I  in  the  figure)  that  provides  a  scalar  mul¬ 
tiplication  of  a  module’s  output  vector.  The  gating  unit 
receives  input  from  priority  units  within  the  module,  and 
from  an  external  attentional  control  that  coordinates  activ¬ 
ity  between  modules.  This  architecture  parallels  certain 
aspects  of  neurophysiology,  and  is  detailed  elsewhere  (see 
[Schneider  &  Detweiler  1987,  Shedden  Ji  Schneider  1991, 
Schneider  &  Oliver,  forthcoming]). 

Figure  1  illustrates  the  overall  model  of  a  visual  search  task. 
“Visual”  modules  VI  and  V2  represent  areas  of  conical  visual 
processing,  each  corresponding  to  the  small  area  of  the  visual 
field  in  which  one  stimulus  appears.  Each  module  consists 
of  an  input  layer  (labeled  I  in  the  figure)  and  an  output  la\er 
(labeled  0).  The  input  layer  projects  via  weighted  connections 
to  the  output  layer,  which  projects  to  a  module  at  the  next 
level  of  processing  (Level  2).  Each  module  also  has  a  layer 
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Figure  1:  Architecture  of  the  model.  Stimuli  from  earlier  suges 
of  visual  processing  enter  the  input  layers  /  of  visual  modules  VI  and 
V2  and  propagate  forward  to  the  output  layers  0  (Level  1  of  pro¬ 
cessing).  The  output  layer  vectors  are  sequentially  transmitted  (under 
external  attentional  control)  to  a  comparator  module  (not  shown), 
where  they  are  serially  compared  with  memory  set  items.  Stimuli 
in  the  input  layers  of  VI  and  V2  also  evoke  a  prioriiy  level  activa¬ 
tion  over  the  layer  of  priority  units  P,  which  also  receive  feedback 
from  the  comparator  module.  The  priority  levels  provide  the  basis 
for  a  transition  from  serial  transmission  and  comparison  of  stimuli 
(attentive  processing)  to  parallel,  automatic  processing  (see  text). 


of  priority  units  Qabeled  P),  which  receives  input  from  the 
module’s  input  layer. 

Unit  1  within  each  module  “gates”  the  forward  propagation 
of  activation  from  the  output  layer.  When  this  gating  is  in  ef¬ 
fect,  no  vector  transmission  from  the  output  layer  of  the  module 
lakes  place,  although  the  activation  of  the  output  layer  is  un¬ 
changed  (e.g.,  as  in  the  inhibition  of  the  axon  initial  segment, 
but  not  the  soma,  of  a  neuron  -  see  [Douglas  &  Martin  1990]). 
However,  the  external  attentional  confrol  can  (by  exciting  Unit 
2,  which  inhibits  Unit  1)  inhibit  Unit  1,  which  will  release 
Unit  I’s  gating  effect  and  lead  to  onward  transmission  of  the 
vector  in  the  output  layer  of  that  module.  The  attentional  con¬ 
trol  thus  provides  for  the  sequential  transmission  of  vectors 
from  the  visual  modules,  which  models  the  shifting  of  atten¬ 
tion  from  one  area  of  the  visual  field  to  another,  i.e.,  from  one 
displayed  stimulus  to  another,  in  the  visual  search  task  (see 
[E^tweiler  &  Schneider,  fonhcoming]). 

When  the  output  layer  vector  of  each  module  propagates 
forward  in  turn,  it  is  compared  senally  with  memory  set  items 
in  a  “comparator”  module  (not  shown  in  Figure  1)^.  If  a  visual 
stimulus  matches  a  memory  set  item,  then  the  output  vector 
of  that  visual  module  also  propagates  forward  to  a  “motor" 
module  at  Level  2  ,  initiating  the  motor  sequence  necessary  to 
produce  the  detection  response. 

This  paper  desenbes  the  prioricy  learning  aspects  of  the 
model,  whereby  learning  alters  the  activity  of  the  pnonty  units 

^Thii  companson  can  be  performed  by  summing  the  iransmiued  vector 
*ach  memory  set  r.em  into  •  layer  of  conneciionisi  units  The  sum  of  the 
squared  acuvauon  of  each  unit  m  the  receiving  layer  then  provides  a  measure 
of  the  correlauon,  or  sundarity  between  the  two  vectors.  If  acuvauon  is  above 
a  entenon  level,  there  is  a  match  of  the  stimulus  with  a  memory  set  item, 
otherwise  no  match.  See  [Shedden  it  Schneider  1991)  for  details. 


and  allows  automatic  transmission  of  the  output  in  the  absence 
of  attentional  control. 

Priority  learning 

A  sensory  system  that  includes  parallel  input  at  early  stages 
with  senal  processing  at  later  suges  would  benefit  from 
a  filtering  system  that  prioritizes  inputs  for  limited  se¬ 
rial  processing.  Early  visual  input  processing  is  parallel 
(fEricksen  &  Spencer  1969]).  With  a  priority  filtenng  scheme, 
a  serial  prextessing  system  can  processes  stimuli  in  their  or¬ 
der  of  importance  following  the  rating  of  stimuli  based  on  a 
parallel  low  level  interpretation  of  stimuli  ([Norman  1969]). 
This  allows  the  most  important  stimulus  to  be  processed 
first  Humans  appear  to  have  such  a  priority  filtering  scheme 
([Yantis  &  Johnson  1990]). 

Our  computational  implementation  of  priority  filtering  is  in 
the  form  of  a  connectionist  network  that  associatively  maps 
each  input  vector  to  a  scalar  priority.  For  example,  in  visual 
search,  each  letter  would  evoke  a  unique  input  vector  of  length 
50  in  a  module  (see  Figure  1).  Each  ir.put  vector  would  asso¬ 
ciatively  evoke  a  scalar  value  specifying  the  prioriiy  (on  a  scale 
of  0  through  10,  represented  by  activation  of  the  prioriiy  units) 
for  that  input  vector.  Input  vectors  evoking  a  high  prionty 
arc  transmitted  to  higher  levels  whereas  low  pnonty  vectors 
are  gated  off,  blocking  the  transmission.  Many  modules  in 
the  visual  system  can  receive  input  simultaneously,  with  the 
respective  input  vectors  each  evoking  a  priority  level,  in  par¬ 
allel.  If  only  one  module  contains  a  high  prionty  target,  it  will 
"pop  out"  of  the  display  ([Triesman  1988]).  This  occurs  by 
having  the  priority  units  inhibit  the  gating  units,  thus  allowing 
the  output  vector  to  be  transmuted  automatically  to  the  next 
level  of  processing^. 

The  priority  units  must  be  trained  to  associate  input  vec¬ 
tors  to  the  appropriate  priority  levels.  This  is  accom¬ 
plished  in  the  current  model  via  feedback  from  the  com¬ 
parator  stage.  We  assume  that  processing  at  the  compari¬ 
son  stage  results  in  higher  output  for  more  important  stimuli 
([Schneider  &  Detweiler  1987]).  A  scalar  transform  of  this 
output  signal  is  fed  back  to  all  modules  at  the  earlier  stage. 
This  becomes  the  target  level  for  the  prionty  units  of  the  trans¬ 
mitting  module.  Shortly  after  a  vector  is  transmitted  out  of  a 
module  under  External  .Mientional  Control,  the  prionty  units 
are  re-trained  to  approximate  the  feedback  signal  via  associa¬ 
tive  learning. 

The  net  result  of  prionty  learning  is  that  if  the  stimulus 
in  a  visual  module  turns  out  to  be  a  target,  then  the  pnonty 
learning  network  is  re-irained  to  evoke  a  higher  pnonty  than 
was  currently  evoked;  if  the  sumulus  turns  out  to  be  a  disiractor. 
then  the  pnonty  learning  network  is  re-trained  to  evoke  a  lower 
pnonty  than  was  currently  evoked. 

The  predicted  effects  of  the  learning  of  pnonucs  are  as  fol¬ 
lows.  In  a  consistent  mapping  task  over  ume.  sumuli  uhat 
enter  modules  VI  and  V2  and  correspond  to  targets  will  evoke 
increasingly  high  pnonucs  in  those  modules,  \\hile  sumuli 


’Figure  1  showj iheexciuiory  connecuonsfrom  Uie  pnoruv  uniu  lo  Lnit  2, 
which  mhibiLs  Lnii  I .  If  ihc  pnonty  Icvci  evokeJ  bv  a  stimulus  is  above  some 
threshold.  L’nii  2  cm  inhibit  Lnii  I  sutficientJy  to  release  its  gating  ctfcct  on  ubc 
output  laver,  resulting  m  m  “auiomauc  '  transmission  from  the  visual  moOuIe 
lo  the  motor  module.  In  this  case,  the  motor  response  is  triggered  wiLboui 
any  sequenuai  scanning  of  modules  under  aiicnuonaJ  coniro).  or  companson 
of  the  stimulus  m  a  module  wnh  memory  set  items.  For  simplicity,  we  have 
omiued  discussion  of  control  signals  from  the  pnonty  units  to  the  estemaJ 
aoenuonal  coniroi.  These  are  desenbed  in  [Schneider  Dciwciicr  1987].  and 
provide  a  mechanism  for  eiiemal  aOeniionai  control  to  entirely  ignore  a  very 
low  pnonty  sumulus.  i  e.,  to  fdU  to  iniuaic  transmission  from  that  module  to 
the  comparator. 
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corresponding  lo  distractors  will  have  increasingly  low  priori¬ 
ties.  Once  the  priorities  evoked  by  a  target  stimulus  in  modules 
VI  or  V2  have  crossed  threshold  level  r,  the  presentation  of 
that  stimulus  in  either  of  those  modules  will  lead  to  automatic 
transmission  from  the  ou^ut  layer  of  that  module  to  the  motor 
module,  without  sequential  scanning  of  the  modules,  or  serial 
comparison  of  their  “contents”  with  memory  set  items.  For 
distractor  stimuli,  low  evoked  priorities  result  in  theu  being 
ignored  by  the  attentional  control.  Thus,  serial,  attentional 
comparison  is  supplanted  by  parallel,  automatic  processing, 
resulting  in  reduced  reaction  times  for  the  detection  of  targets, 
and  in  the  independence  of  reaction  time  from  memory  set  size. 

In  a  varied  mapping  task,  however,  since  a  particular  stim¬ 
ulus  is  sometimes  a  target  and  sometimes  a  distractor,  there 
is  no  gradual  increase/decrease  of  priorities  for  different  sets 
of  stimuli.  Instead,  the  priority  levels  of  stimuli  will  tend  to 
fluctuate  around  the  default  prionty  level.  That  is,  the  evoked 
priority  levels  of  presented  stimuli  do  not  cross  threshold,  and 
so  there  is  no  automatic  over-ride  of  attentional  processing, 
and  no  “ignoring”  of  stimuli.  The  production  of  the  detection 
response  has  to  continue  to  be  through  serial  attentional  com¬ 
parison.  Accordingly,  there  will  be  no  decrease  in  reaction 
times,  or  in  their  linear  relationship  with  memory  set  size^. 

Implementation  of  priority  learning 

We  ran  simulations  of  the  priority  learning  component  of  the 
architecture  outlined  above,  using  a  single  two-layer  connec- 
tionist  network  incorporating  the  input  layer  and  priority  layer 
of  one  visual  module  shown  in  Figure  1.  Our  aim  was  to 
examine  whether  a  priority  learning  scheme  would  provide  a 
basis  for  the  practice  effects  observed  in  consistent  mapping 
and  varied  mapping  paradigms. 

Stimuli  entering  the  network’s  input  layer  (Input,  corre¬ 
sponding  to  layer  /  in  Figure  1)  are  vectors  of  length  50,  with 
each  element  being  in  the  range  ±1.0;  that  is,  the  input  layer 
consists  of  50  units.  The  prionty  layer  (Priority,  correspond¬ 
ing  to  layer  P  in  Figure  1)  consists  of  10  units^.  A  stimulus  in 
Input  is  uansmitted  in  feed- forward  fashion  to  Priority.  Net 
input  to  each  priority  unit  is  computed  as  the  weight^  sum 
of  inputs  from  all  the  input  units.  The  priority  level  evoked 
by  a  stimulus  is  computed  by  a  simple  count  of  the  number  of 
priority  units  in  Priority  that  have  positive  net  input.  Thus  if 
ail  ten  priority  units  have  negative  net  input,  the  priority  level 
is  computed  as  0;  if  n  pnority  units  have  positive  net  input,  the 
priority  level  is  n,  with  the  highest  possible  priority  being  10. 
Bias  to  the  priority  units  is  distributed  linearly  over  the  range 
±0.40,  so  that  five  priority  units  have  a  positive  bias,  and  five 
a  negative  bias.  In  the  absence  of  input  to  the  priority  units 
from  Input,  therefore,  the  evoked  prionty  level  has  the  default 
value  of  5. 

When  a  stimulus  is  presented  to  the  network,  a  pnonty  vector 
is  evoked  at  the  pnonty  layer.  The  network  is  then  re-trained 
to  evoke,  for  the  current  stimulus,  either  a  higher  pnonty  level 
than  currently  evoked  (if  the  current  sumulus  is  designated 
a  target),  or  a  lower  pnonty  level  than  currently  evoked  (if 
the  current  stimulus  is  designated  a  distractor)*.  This  will  be 
referred  to  as  the  incrementing  and  decrementing  of  pnonty. 
respectively.  The  simulations  desenbed  here  have  employed 

*Aikin«on  &  Juoli  ([AJiifnon  A  JuoU  1973))  have  preienied  a  timilar 
molieiof  recency  Icammij,  ji  N^^nich  siimuu  of  inLcrmcdiaie  fimfLianiy  require 
aitenuofiai  scanning  while  novel  sumuli  do  not. 

^AJihough  our  simulauons  have  used  a  Zayer  of  10  pnonty  uniis,  it  should 
be  possible  lo  achieve  die  same  cffccu  wnh  a  single  pnonty  unit 

*Thc  higher  or  lower  pnonty  levels  correspond  to  modulation  of  pnonty 
layer  acuvaiions  by  feedback  from  the  comparator  module. 


the  Widrow-Hoffleaming  algorithm  ([Widrow  &  Hoff  I960]). 
One  epoch  consisted  of  presentation  of  the  enure  set  of  stimuli, 
with  appropriate  incrementing/decrementing  of  pnonty  after 
presentauon  of  each  stimulus. 

Simulations  of  priority  learning 

Simulation  1:  Consistent  mapping.  In  consistent  map¬ 
ping  studies  with  human  subjects,  the  rate  of  search  has  been 
shown  to  become  much  faster  with  pracuce  ([Neisser  1963]). 
Studies  with  well-practiced  human  subjects  have  exhib¬ 
ited  reaction  times  that  varied  relatively  little  with  mem¬ 
ory  set  size  ([Schneider  &  Shiffrin  1977,  Experiment  2], 
[Neisser,  Novick  &  Lazar  1963]). 

In  our  simulations  of  consistent  mapping,  the  training  set 
for  a  module  consisted  of  16  random  vectors,  which  were 
partitioned  into  two  disjoint  sets  of  8  stimuli  each,  one  set  being 
designated  targets,  and  the  other  distractors.  During  pnonty 
learning,  the  evoked  priorities  were  consistently  incremented 
or  decremented  for  the  two  sets  of  stimuli  respectively. 

The  results  of  the  consistent  mapping  simulauons  are  shown 
in  Figure  2a.  The  slopes  show  the  evoked  mean  priority  level 
of  targets  and  distractors.  as  a  function  of  training  (epochs). 
With  increased  epochs  of  uaining,  target  sumuli  come  to  evoke 
increasingly  high  priorities,  while  distractor  stimuli  have  in¬ 
creasingly  low  pnorities.  As  discussed  in  the  secuon  on  pri¬ 
ority  learning,  a  visual  module  in  which  a  stimulus  evokes  a 
priority  level  of  greater  than  some  threshold  r  will  automati¬ 
cally  uansmit  the  vector  in  its  output  layer. 

Figure  2b  shows  reaction  umes  for  targets  in  consistent  map¬ 
ping  expenments  with  human  subjects,  who  were  uained  over 
a  period  of  36  days  ([Kristofferson  1972b]).  Memory  set  sizes 
of  one,  two  and  four  were  used.  For  each  set  size,  there  was  a 
decrease  in  reaction  time  over  the  uaining  period,  w  hich  is  in¬ 
terpreted  as  being  largely  due  u  speeding  up  of  non-attentional 
components  such  as  the  motor  response  component  of  the  task, 
which  is  also  the  case  in  varied  mapping  tasks  ([Shiffrin  1988, 
page  748]).  Figure  2b  also  illustrates  the  non-linear  set  size 
functions  characteristic  of  consistent  mapping. 

The  priority  levels  of  targets  in  our  simulations  of  consis¬ 
tent  mapping  give  rise  to  similar  reaction  Umes.  On  each 
epoch,  search  time  S  for  a  target  was  simulated  as  follows. 
If  the  priority  level  evoked  by  the  sumulus  was  greater  than 
a  threshold  level  r,  then  the  sumulus  would  evoke  automauc 
detection,  taking  “automatic  response  time"  A.  If  the  pnonty 
level  was  below  threshold,  then  the  target  would  have  to  be 
compared  serially  with  memory  set  items,  wiih  each  such  com¬ 
parison  taking  a  constant  “comparison  ume”  C.  We  assumed 
non-terminaung  search,  so  that  the  number  of  compansons  re- 
quued  is  equal  to  memory  set  size  m.  Total  reaction  ume  for 
a  target  was  therefore  calculated  as  (i)  a  base  time  B,  repre- 
senung  non-attenuonaJ  factors,  plus  (ii)  search  ume  S,  which 
was  cither  (a)  automatic  detection  ume  A  (if  the  pnonty  level 
was  greater  than  r),  or  (h)  conuolled  response  time  equal  to 
companson  ume  C  Umes  memory  set  size  m  (if  the  pnonty 
level  was  less  than  r). 

The  Ume  per  companson  C  was  taken  to  be  50  msec,  an  1 
the  ume  for  an  automaUc  response,  40  msec.  We  used  pnonty 
threshold  r  =  8  0.  We  used  a  base  reacuon  ume  5  of  290  msec, 
which  decayed  to  about  230  msec  over  200  epochs  of  iraininc, 
simulaung  the  speed-up  of  non-aitentional  components  of  re¬ 
acuon  umes\  Figure  2c  shows  the  simulated  reaction  umes. 


'These  figures  were  denved  from  ihc  human  sub'cci  data  bv  subiracimg 
ihc  Ume  for  one  aueniional  companson  (50  msec )  frt'm  loul  reaction  time  for 
memory  set  siie  one  (a)  at  Days  1-6  (approximately  340  msec),  and  (h)  at 
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Figure  2;  Priority  learning  simulation  results,  (a)  Prionty  levels  m  consistent  mapping  simulauon  (Simulation  1),  (b)  Human  subject 
reaction  times  for  target  stimuli  in  a  consistent  mapping  task,  after  M.  Ktslofferson,  "When  Item  Recognition  and  Visual  Search  Functions  are 
Similar”,  Perception  and  Psychophysics,  12,  p.381.  (c)  Simulated  reaction  ames  for  targets,  averaged  over  five  consistent  mapping  simulation 
runs  (Simulauon  1).  (d)  Prionty  levels  in  vaned  mapping  simulabon  (Simulauon  2).  (e)  Human  subject  reacuon  times  for  ail  sumuli  in  a  vined 
mapping  task,  after  M.  Krisiofferson.  '‘Effects  of  Pracuce  onC\Mszc\cTC\»s%\Sic»tion''  .Ccutadian  Journal  of  Psychology  26.  p.57.  (f)  Simulated 
reaction  times  for  all  stimuli,  in  vaned  mapping  simulation  (Simulauon  2).  (g)  Pnonty  levels  with  reversal  of  largeis/disuaciors  in  consistent 
mapping  (Simulauon  4).  (h)  Detection  accuracy  with  reversal  of  targeis/distractors  in  consistent  mapping  (Simulauon  4).  (i)  Pnority  levels  of 
stimuli  with  varying  degrees  of  consistency  (Simulauon  5). 
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for  memory  set  sizes  of  one,  two  and  four.  Levels  of  practice 
are  shown  in  terms  of  average  reaction  time  over  blocks  of 
50  epochs,  corresponding  to  the  average  reaction  times  over 
blocio  of  days  in  Figure  2b. 

As  in  the  human  data  (Figure  2b),  the  simulation  results 
(Figure  2c)  show  a  downward  shift  (with  practice)  of  reaction 
times  for  each  memory  set  size;  this  is  the  combined  result  of 
decreasing  base  response  times  as  well  as  of  developing  auto¬ 
matic  responses.  Moreover,  the  reaction  times  for  different  set 
sizes  at  a  particular  level  of  practice  exhibit  the  non-linearity 
expected  in  a  consistent  mapping  task.  Overall,  the  simulation 
results  appear  to  model  the  human  data  quite  well*. 

Simulation  2:  Varied  mapping.  Varied  mapping  studies 
with  human  subjects  have  found  that  search  time  continues 
to  be  a  linear  function  of  memory  set  size,  even  after  practice 
([Kristofferson  1972a)).  In  our  simulations  of  varied  mapping, 
the  training  set  for  a  module  consisted  of  16  random  vectors. 
The  priority  level  for  each  stimulus  was  incremented  or  decre¬ 
mented  at  random,  modeling  the  effect  of  stimuli  not  being 
treated  consistently  either  as  targets  or  distractors. 

Results  from  the  varied  mapping  simulations  are  shown  in 
Figure  2d,  which  plots  the  mean  evoked  priority  of  all  stimuli. 
The  mean  priority  levels  fluctuate  around  the  “default”  priority 
level  of  5,  even  with  extended  practice,  as  a  result  of  the  non- 
consistent  treatment  of  stimuli.  Note  that  in  the  simulation 
results  shown,  there  is  an  initial  random  increase  in  mean 
priority;  in  other  simulations,  there  was  an  initial  decrease  in 
priorities.  But  in  all  cases,  the  mean  pnority  settled  around  the 
value  of  5. 

Human  reaction  times  from  a  varied  mapping  task 
([Kristofiferson  1972a])  are  shown  in  Figure  2e  (all  stimuli), 
which  shows  that  detection  times  remain  linear  with  memory 
set  size,  even  with  extended  practice.  The  priority  levels  of 
stimuli  in  our  varied  mapping  simulation  give  rise  to  similar 
reaction  times,  calculated  in  the  same  way  as  for  consistent 
mapping  (Figure  2f).  As  in  the  human  subject  da'.a,  practice 
does  not  change  the  linearity  of  set  size  functions.  The  reason 
for  this  is  that,  since  few  stimuli  achieve  threshold  priority 
levels,  serial  comparison  remains  the  only  basis  for  target  de¬ 
tection.  Automatic  detection  does  not  develop,  and  therefore 
search  functions  remain  linear  with  set  size.  Thus  our  simula¬ 
tion  provides  a  good  match  with  the  observed  varied  mapping 
results’. 

Simulation  3:  Consistent  &  Varied  mapping  combined. 
Schneider  and  Fisk  conducted  an  experiment  in  which  subjects 
were  asked  to  carry  out  a  consistent  mapping  task  and  a  var¬ 
ied  mapping  task  simultaneously  ([Schneider  &.  Fisk  1982a]). 
The  findings  were  that  both  tasks  could  be  accomplished  si¬ 
multaneously  about  as  well  as  when  each  task  was  carried  out 
alone. 


Days  3 1  -36  ^approxunatciy  2S0  msec).  Thu  decrease  in  base  ume.  from  290 
msec  to  230  msec,  was  fiaed  by  an  exponenuai  funcuon  with  constant  0  9985. 
as  a  first  approximauon. 

*CXif  model  predicts  that  reaction  time  functions  will  become  perfectly  flat 
at  some  point  This  docs  occur  in  our  simuiauons,  by  approx.  400  epochs  of 
training 

’Note  that  the  behavior  of  the  slopes  of  simulated  reaction  times  fit  the 
human  data  quite  well,  which  was  the  maior  focus  of  interest  in  this  paper. 
By  contrast,  the  changes  in  intercept  fi  c.,  base  reacuon  time)  in  simuiauons 
do  not  fit  the  human  dau  well.  This  is  because  simulauon  of  the  base  time 
pracucc  effect  did  not  include  an  asymptote  effect  and  hence  overestimated 
U’le  decrease  in  base  ume.  With  humans,  decreases  in  base  ume  seem  to 
asymptote  at  approximaielv  200  msec.  Adding  an  addiuonal  parameter  to  the 
model  would  aiiow  a  good  fit  of  both  the  constant  slope  and  declining  intercept 
effect  in  vaned  mapping. 


We  ran  simulations  in  which  32  stimuli  were  partitioned  into 
two  sets  of  16  stimuli  each.  One  set  of  16  stimuli  represented 
a  consistent  mapping  task:  8  of  the  stimuli  were  treated  as 
targets,  and  the  other  8  as  distractors.  The  other  set  of  16 
stimuli  represented  a  varied  mapping  task,  and  the  stimuli 
were  created  randomly  as  targets  and  distractors.  One  epoch 
involved  presentation  of  all  32  stimuli,  and  represented  the 
simultaneous  performance  of  both  the  consistent  and  varied 
mapping  tasks  on  different  sets  of  stimuli. 

The  priority  levels  of  consistently  mapped  stimuli  (which 
were  consistently  either  targets  or  distractors)  separated  as  in 
the  consistent  mapping  task  alone.  The  average  evoked  prior¬ 
ity  of  the  varied  mapping  stimuli  remained  close  to  the  default 
priority  level  of  5,  as  in  the  varied  mapping  task  alone.  Thus 
the  priority  levels  of  both  the  consistent  and  varied  mapping 
stimuli  were  similar  to  those  in  each  of  the  tasks  performed 
independently,  indicating  that  practice  effects  in  the  combined 
consistent  and  varied  mapping  task  can  be  modeled  in  terms 
of  priority  learning  under  the  same  assumptions  as  for  the 
independent  tasks,  in  conformity  with  the  findings  of  the  ex¬ 
periment  described  above. 

Simulation 4:  Target/distractor  reversal  in  consistent  map¬ 
ping.  Implicit  in  the  priority  learning  scheme  we  have  pre¬ 
sented  is  the  hypothesis  that,  in  consistent  mapping,  with  prac¬ 
tice.  target  stimuli  come  to  “attract  attention”  to  themselves. 
Shiffrin  and  Schneider  empirically  verified  the  prediction  that 
if  the  set  relationships  are  reversed  after  the  priorities  have  been 
established,  subjects’  performance  deteriorates  below  that  of 
novice  subjects.  For  example,  in  initial  practice,  targets  might 
be  {A  B  C},  with  (X  Y  Z)  as  distractors.  After  reversal,  {X 
Y  Z)  would  be  the  targets,  and  {A  B  C}  the  distractors.  This 
reversal  is  expected  to  produce  detenoration  because  the  stim¬ 
uli  that  were  previously  targets  attract  attention  away  from  the 
previous  distractors  that  become  the  new  target  stimuli. 

In  the  experiments,  subjects  practiced  a  consistent  mapping 
task  ([Shiffrin  &  Schneider  1977,  Experiment  1]).  Once  per¬ 
formance  had  stabilized  (2100  trials),  targets  and  distractors 
were  interchanged.  On  reversal,  detection  accuracy  dropped 
to  below  the  level  it  had  been  at  the  beginning  of  the  onginal 
consistent  mapping  task  (approximately  50  percent),  and  900 
trials  were  nc^ed  for  accuracy  to  return  to  the  novice  level 
with  targets  and  distractors  reversed.  Subsequently,  gradual 
re-leaming  occurred,  and  accuracy  reached  the  previously  es¬ 
tablished  level. 

We  simulated  this  reversal  in  a  consistent  mapping  task.  A 
consistent  mapping  simulation  was  run  with  a  set  of  target 
stimuli  and  a  set  of  disu^ior  stimuli  for  1000  epochs.  At 
the  end  of  1000  epochs,  the  targets  and  distractors  were  re¬ 
versed,  i.e.,  the  prionties  of  the  former  distractors  were  now 
consistently  incremented,  and  those  of  the  former  uirgcu:  '.'■’'■'•p 
now  consistently  decremented.  The  simulation  was  run  in  this 
reversed  condition  for  a  further  1000  epochs. 

Figure  2g  shows  that  the  mean  pnonty  levels  of  the  onginal 
targets/disu-xiors  incrcase/decrease  over  the  first  1000  epochs 
of  consistent  mapping  training.  When  targets  and  distrxiors 
are  reversed  at  epoch  100 1,  the  pnonty  levels  of  former  targets 
start  dropping  sharply,  and  those  of  former  distractors  start 
increasing  sharply. 

We  computed  an  xcuracy  measure  as  follows;  a  given  stim¬ 
ulus  prcscniauon  was  considered  to  have  evoked  an  accurate 
response  either  if  (i)  the  stimulus  was  a  target,  and  evoked 
a  priority  of  above  threshold,  or  (ii)  it  was  a  distractor.  and 
evoked  a  pnonty  of  below  threshold.  The  threshold  pnonty 
level  used  was  9.50.  Figure  2h  shows  the  vanation  of  this 
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accuracy  measure.  Ai  the  start  of  initial  consistent  mapping 
training,  accuracy  was  approximately  50  percent,  and  this  im¬ 
proved  steadily,  asymptoting  by  about  500  epochs  of  training. 
When  targets  and  distractors  were  reversed  at  epoch  1001, 
accuracy  dropped  sharply,  to  below  the  level  at  the  start  of 
the  simulation,  and  it  required  approximately  100  epochs  of 
training  to  reach  that  level  (50  percent).  Beyond  this  point, 
re-leaming  occurred  gradually,  and  by  epoch  1500,  accuracy 
had  returned  to  the  previous  maximum.  Thus  the  simulation 
models  the  human  data  fairly  well. 

Simulation  5:  Degree  of  consistency.  Schneider  and  Fisk 
found  that  consistency  has  a  graded  rather  than  an  all-or- 
none  effect.  In  one  experiment,  subjects  searched  for  one 
letter  (i.e.,  memory  set  size  1)  in  frames  containing  four  letters 
([Schneider  &  Fisk  19«2h.  Experiment  1]).  Subjects  were  re¬ 
quired  to  indicate  the  frame  ^sition  in  which  the  target  had 
appeared,  at  the  end  of  each  trial.  The  degree  of  consistency  of 
appearance  of  letters  as  targets  or  distractors  varied.  Thus  one 
letter  had  the  consistency  ratio  10:0,  meaning  that  it  appeared 
as  a  target  in  10  trials  per  block  of  trials,  and  never  as  a  distrac- 
tor.  Three  other  letters  had  the  consistency  ratios  10:5,  lOrlO 
and  10:20,  respectively.  Five  other  letters  each  had  degree  of 
consistency  9:61. 

Throughout  the  experiment,  detection  accuracy  was  highest 
for  the  10:0  letter,  followed  closely  by  the  10:5  condition.  De¬ 
tection  accuracy  was  lowest  for  the  10:20  and  9:61  conditions, 
which  did  not  differ  substantially  from  each  other.  The  10:10 
letter  showed  intermediate  detection  accuracy. 

In  our  simulation,  our  training  set  consist^  of  five  stimuli, 
which  we  designated  A.  B,  C.  D  and  E.  One  epoch  consisted  of 
the  appearance  of  each  of  the  letters  A,  B,  C  and  D  10  times  as 
a  target,  and  0. 5, 10  and  20  limes,  respectively,  as  a  distractor; 
thus  these  letters  corresponded  to  the  consistency  ratios  10;0, 
10:5, 10:10  and  10:20,  respectively.  The  E  stimulus  appeared 
9  limes  as  a  target  and  61  times  as  a  distractor,  corresponding 
to  the  consistency  condition  9:61.  The  simulation  involved 
presentation  of  this  training  set  to  a  network  representing  the 
priority  learning  component  of  a  single  module.  By  approxi¬ 
mately  70  epochs  of  training,  the  priority  levels  of  the  A,  B,  C, 
D  and  E  stimuli  had  seiUed  to  10,  8,  5,  2  and  0.  respectively 
(Figure  2i). 

Although  we  have  not  constructed  simulations  correspond¬ 
ing  to  the  overall  architecture  that  would  be  required  for  a  sim¬ 
ulation  of  the  experiment  described  above,  the  priority  learning 
results  from  the  simulation  with  a  single  module  suggest  accu¬ 
racy  would  be  a  graded  function  of  the  degree  of  consistency. 
The  overall  model  would  incorporate  four  modules  VI,  V2. 
V3  and  V4,  corresponding  to  the  visual  fields  in  which  each 
of  the  four  letters  m  a  frame  appear.  The  process  of  training 
would  lead  to  each  of  the  modules  having  the  pnonty  levels 
described  above,  which  developed  for  a  single  module.  .■\ 
winner-iake-all  network  between  modules  would  lead  to  pro¬ 
cessing  of  stimuli  in  their  order  of  pnonty.  so  that  attention 
would  be  prcferenually  attracted  to  a  higher-pnonty  item  even 
when  it  is  not  the  target.  Consequently,  accuracy  would  be 
greater  for  highcr-pnonty  items. 

Conclusions 

This  paper  has  examined  the  viability  of  proposed  “pnonty 
learning”  mechanisms  as  the  basis  of  a  computational  model 
of  a  number  of  the  phenomena  observed  in  visual  search  tasks 
performed  by  human  subjects.  The  simulation  results  that  have 
been  presented  are  consistent  with  a  fairly  broad  set  of  exper¬ 
imental  findings.  We  therefore  conclude  that  prionty  learning 


provides  a  fairly  good  account  of  practice  and  automaticity 
effects  in  visual  search  tasks. 
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